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Abstract 

This paper considers a network of stochastic evidence accumulators, each represented by a drift- 
diffusion model accruing evidence towards a decision in continuous time by observing a noisy signal and 
by exchanging information with other units according to a fixed communication graph. We bring into 
focus the relationship between the location of each unit in the communication graph and its certainty 
as measured by the inverse of the variance of its state. We show that node classification according to 
degree distributions or geodesic distances cannot faithfully capture node ranking in terms of certainty. 
Instead, all possible paths connecting each unit with the rest in the network must be incorporated. We 
make this precise by proving that node classification according to information centrahty provides a rank 
ordering with respect to node certainty, thereby affording a direct interpretation of the certainty level 
of each unit in terms of the structural properties of the underlying communication graph. 
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I. Introduction 

IN networks of sensors accumulating evidence by observing noisy processes, information 
sharing among the individual sensing units can significantly affect their certainty about the 
processes observed. Depending on the communication architecture, units that are more certain 
than others emerge, and these more certain units may prove to be more reliable decision makers 
in collective decision-making tasks PJ, or more influential components in consensus-seeking 
networks in the presence of noise O, flU. 

The identification of the most certain units in a network of interconnected systems is central to 
shaping collective behavior. For instance, teams of autonomous vehicles used as mobile sensor 
networks in the ocean jSl, on land jH, in the air and in space 0, jSl, must perform exploration, 
surveillance, monitoring, search and rescue, and manipulation tasks by responding quickly and 
accurately to noisy measurements of uncertain environmental processes flU. If it is understood 
which individuals are the most certain about their environment due to their location in the 
network, protocols could be adapted so that these individuals dominate the group's behavior, 
e.g. by suitably weighting the information supplied [[TOl . or the decision made [[TT|. by each 
unit. 

The contribution of the present paper is to characterize the impact of the communication 
architecture on the quality of the information content of each unit in a network of stochastic 
evidence accumulators. In decision making, evidence accumulation often assumes that relevant 
information is collected sequentially, through a series of independent scalar observations. This 
assumption forms the basis for a large class of decision-making tests, including Wald's Sequential 
Probability Ratio Test (SPRT) and its variations [fT2l . [[T3l . In the classical two-choice SPRT 
test, the information accrued by a detector is processed to form a likelihood ratio; as successive 
samples are collected, the evolution of the likelihood ratio is equivalent to a discrete-time biased 
random walk [fT4l . 

In continuous-time implementations of sequential binary hypothesis tests, evidence accumu- 
lation is represented through linear [[TSl . or nonlinear [[T6l . stochastic differential equations. The 
relationship between discrete and continuous implementations of the SPRT is discussed in lfl4l . 
where it is shown that, under the assumption of infinitesimal increments of information arriving 
at each moment in time, the logarithmic likelihood ratio in the SPRT converges in distribution 
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to a stochastic differential equation with constant drift and diffusion terms: the drift-dijfusion 
model (DDM). 

In this paper, we adopt the DDM as a basis for modeling information accumulation by a single 
unit, and we study a network of DDMs where there is communication of accumulating evidence 
among the units. Our motivation for using the DDM stems in part from a class of models 
employed to formally investigate the cognitive and neural processes that underlie decisions in 
humans and animals ifTTl . [[T4l|. Notwithstanding the underlying complexity of human and animal 
decision making, carefully controlled decision-making experiments modeled using drift-diffusion 
processes have proved instrumental in explaining the fundamental tradeoffs between speed and 
accuracy of a decision, and the conditions under which optimality is achieved [[T4|. 

Another source of motivation for focusing on networks of DDMs is their relevance to the 
design of multi-agent systems ifTSl . and to the study of collective dynamics in biological systems 
lfT9l . Multidimensional DDMs can be interpreted as stochastic extensions of deterministic linear 
consensus dynamics [|20ll - [|22ll . and have been applied in S, flU to analyze the performance of 
consensus protocols in the presence of noise. In particular, [[3]|, ^ investigate the robustness of 
consensus to communication noise through the H2 norm of a reduced-order system that measures 
the expected steady-state dispersion of the agents around the consensus subspace. 

Rather than analyzing the collective effect of noise as in S, flU, this paper focuses on assessing 
the contribution of each unit to the uncertainty of the process by identifying the structural 
elements of the network that govern the unit's individual behavior. From this perspective, our 
work complements research on controllability of networks [|23l . in which the notion of nodal 
degree is identified as the structural element of the network that determines the units whose 
direct control ensures controllability of the network. The degree distribution is also important in 
specifying which nodes are critical to maintaining a network's structural integrity under random 
failures or targeted attacks [|24|. Il25l . However, as we show in this work, the notion of nodal 
degree cannot be used to assess the significance of each unit based on certainty. 

Quantifying the effect of the network structure on individual behavior naturally leads to the 
concept of centrality ll26l . Centrality measures typically assign to each node a quantity that 
reflects its location in the network and summarizes the node's involvement in the cohesiveness 
of the network process. Motivated by the structural properties of the star graph. Freeman 
II27I proposed a categorization of centrality measures based on node degree, closeness and 
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betweenness. The degree centrality of a node depends on the number of nodes adjacent to 
it, and it is an intrinsically local metric of centrality. In contrast, closeness and betweenness 
adopt a more global perspective by relying on shortest — i.e., geodesic — paths connecting pairs 
of nodes [|27l . Centrality indices based on geodesic paths are also discussed in 11281 . where it is 
pointed out that such measures may capture certain network organizational effects that cannot 
be distinguished by local measures, such as degree distributions. 

However, the choice of the geodesic path as the structural ingredient of the graph based on 
which centrality is defined cannot capture the finest structure of the network because it neglects 
communication along non-geodesic pathways [|29ll . [|30ll . Indeed, evidence transmitted by each 
unit through the network can reach the rest of the units via circuitous, not necessarily geodesic, 
pathways. 

To incorporate non-geodesic paths, Stephenson and Zelen proposed information centrality and 
applied it to interpret the spread of an infectious disease in a network of interconnected individu- 
als ll29l . Following ll29l , the work in [[3TI showed that information centrality can be reinterpreted 
as the electrical conductance of an equivalent electrical network and proposed an improved 
algorithm for its computation. This analogy reveals the intrinsic connection between information 
centrality and effective resistance, which was found relevant in many fields beyond electrical 
network analysis; see [[32l for applications including Markov chains, averaging networks, and 
linear parameter estimation. The connection between the estimation error covariance and the 
effective resistance is discussed in [l33l in the context of estimating vector-valued quantities 
from relative noisy measurements. In a different context, the total effective resistance has been 
related to the robustness of consensus to white noise in [0. 

In the present work, we elucidate the relationship between the location of a node in the 
communication topology and its certainty as it collects and exchanges information with its 
neighbors; that is, the nodes with which it can communicate. We start by adopting the drift- 
diffusion model for sequential evidence accumulation in continuous time for an individual unit, 
and extending it to consider multiple such units interconnected according to communication 
topologies with normal graphs. Based on this model we introduce an index that characterizes 
the certainty of each unit by considering the difference between its variance and the minimum 
possible variance it can attain. We then provide a formal connection between the certainty index 
and the notion of information centrality ll29l by proving that ordering of nodes with respect to 
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information centrality predicts ordering of nodes with respect to certainty. This demonstrates 
that collective evidence accumulation is a total network process: the entirety of paths connecting 
a unit with the rest of the network — including paths that are not geodesic — affect the unit's 
certainty as it integrates noisy information about an external signal or decision alternative. 

The structure of this paper is as follows. Section |n] motivates the DDM as a model for 
evidence accumulation in decision making and it extends it to a network setting. Section UlI] 
defines an index for classifying the nodes according to their certainty. Section |IV] provides our 
main result that interprets the node certainty index based on the structural properties of the 
communication graph through the notion of information centrality. Sections |V] and |VI] present 
comparisons between certain classes of graphs in terms of the certainty of their nodes. Section 
IVIII concludes the paper. 

IL Model 

This section describes the drift-diffusion model (DDM) of evidence accumulation and its 
extension to a network setting. 

A. Sequential Evidence Accumulation 

In its standard form, the DDM corresponds to the stochastic differential equation 

dx = Pdt + adW, (1) 

where /3 is a constant drift term and adW are increments drawn from a Wiener process with 
standard deviation a. The interpretation of the random process {x{t) : t > 0} evolving according 
to © in the context of evidence accumulation is the subject of this section. 

In the decision-making literature, the DDM arises in a variety of ways; detailed accounts 
can be found in extensive reviews on the diffusive paradigm of decision making as in lfT4ll for 
example. One way to interpret ([U) is to consider the continuous-time limit of the logarithmic 
likelihood ratio in the classical SPRT. Following Wald's treatment lfT2l . suppose that F is a 
random variable and let Hq and Hi denote the hypotheses that the probability distribution of 
Y is po(y) (null hypothesis) and pi{y) (alternative hypothesis), respectively. The objective is to 
decide which hypothesis is the correct one on the basis of a sequence of independent observations 
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yi,y2, ■■■,yN of Y. in the SPRT, incoming data are processed to form a likelihood ratio 

^ Po{yi)po{y2) ■ ■ -poiyN) ^2) 
^ pi{yi)pi{y2)---Pi{yN)' 

which summarizes the information available up to and including the current (A^-th) observation 
UN- If yN supports hypothesis Hq, the ratio Poiy n) / Pi{y n) is greater than one — that is, is 
more likely under Hq than under Hi — and then Ajv increases. On the other hand, if yi^ supports 
Hi, the ratio Po{y n) / Pi{y n) is lower than one and Aat decreases. 

Applying logarithms, the likelihood ratio ^ represents a discrete random walk evolving 
according to 

A^ = Ajv-i + log — — -, (3) 

Pi{yN) 

where A^r = logA^v and log corresponds to the increment of information gained from 

observation y^. It is shown in [|T4il that under the assumption of infinitesimal increments of 
information arriving at each moment in time, and up to an unimportant scaling factor, the discrete 
random walk ([3]) converges in distribution to the process described by ©. In light of this result, 
the meaning of ([U) becomes clear: its solution {x{t) : t > 0} denotes the accumulated value 
at time t of the difference in the information favoring one hypothesis over the other, while the 
constant drift (3 represents increase in the evidence supporting the correct decision. 

In a different, neurally-motivated, decision-making context, the DDM ^ appears as a model 
for evidence accumulation through appropriate reductions in models of competing leaky accumu- 
lators as detailed in |[T4l . Such models have been proposed to explain the neural mechanisms of 
integration of information in perceptual choice tasks ll34l . and they correspond to two mutually 
inhibitory, competing neural populations, which provide evidence supporting each of the two 
hypotheses. 

Other discrete- and continuous-time models that have been proposed to investigate the neural 
mechanisms of decision making also reduce to the DDM as a model for evidence accumulation 
in continuous time; see [14] for a detailed review. The majority of these models aim to capture 
the phenomenology of such processes and are carefully justified through experimental data. On 
the other hand, ll35l arrives at the DDM ^ via a mechanistic approach, providing a quantitative 
link from the microscopic, short-time statistics of neuronal representations to the macroscopic, 
long-time statistics of information accumulation processes. 
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B. Networks of Interconnected DDMs 

We model a network of n evidence accumulating units as the interconnection of n DDMs that 
share the relative value of their evidence with those units with which they can communicate. In 
more detail, the state Xk of unit k, for each A; = 1, . . . , n, evolves according to 



where, in analogy with ([T]), (3 represents a constant drift term and adWk corresponds to incre- 
ments drawn from independent Wiener processes with standard deviation a. In (|4l), akj > 
denotes the attention paid by unit k to the difference between its state Xk and the state Xj of 
unit j; akj = implies that the units k and j do not communicate. 

The model dH) can be associated with a collective decision-making scenario, in which a set of 
interconnected decision-making units is presented with partial information about a stimulus — 
e.g., a deterministic signal corrupted by noise — and each unit is asked to identify it between two 
alternatives within a finite time interval [HI. 

Beyond decision making, the model (|4]) with (3 = has been used to determine sufficient 
and necessary conditions for mean-square average consensus under measurement noise J36l, 
and to analyze the stochastic stability dH, and robustness flSl, of linear consensus algorithms in 
the presence of (white) noise. A common metric for assessing the quality of consensus under 
measurement noise is the trace of the stationary covariance matrix associated with the projection 
of the state on the subspace orthogonal to the consensus subspace [|3l, flU; see also ll37l that 
uses a similar metric for the discrete-time case. 

Such metrics capture the collective effect of the uncertainty; but, they do not distinguish the 
individual contributions of the nodes to the dispersion around the consensus subspace. It is 
therefore natural to ask how the uncertainty of each node affects the total uncertainty of the 
process, and how individual contributions can be characterized based on the locations of the 
nodes in the underlying interconnection graph. Our aim in this paper is to provide an answer to 
these questions. 

C. Notation and Basic Properties of the Model 

It is useful to identify the communication topology in the network with a digraph Q = 
{V,E,A). The vertex set V := {vi,...,Vn} contains n nodes that represent the n evidence 
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accumulators. The edge set £^ C V x V contains the communication links among the nodes, 
and A E ]R"q" is the corresponding weighted adjacency matrix. The elements of A are denoted 
by ttfcj > and defined as follows: for Vk,Vj E V, a^j > if e^j = {vk,Vj) E S, and 
akj = otherwise. Throughout this work, a "sensing" convention is adopted: a (directed) 
edge Ckj = {vk.Vj) E S implies that node Vj transmits information about its state to node 
Vk- Graphically, Ckj is represented by an arrow from node Vk to node Vj, implying that node 
Vk can "sense" the state of node Vj, and we say that Vj is a "neighbor" of Vk- We will assume 
that there are no self-loops in Q, i.e., Ukk = for all Vk E V. The out- and in-degree of a node 
Vk eV can be defined by 

n n 

degout(^'fc) := ^(^kj and deg;^{vk) := ^a^-fc, 
i=i j=i 

respectively. If deg^^^{vk) = deg^j^{vk) for all Vk E V, the graph Q is called balanced. 
In this notation, dH) takes the form 

dx= {b- Lx) dt + HdW, (5) 

where x := col(xi, . . . , dW := co\{dWi, . . . ,dWn), b := /31„ and H := cr/„; 1„ is the 
n-dimensional vector with entries all equal to one and J„ is the n x n identity matrix. In L 
is the Laplacian matrix associated with defined by 



aki, k = j, 

i=lMk (6) 



-akj, k^j. 

By construction, 1„ is an eigenvector of L corresponding to the eigenvalue Ai = 0. Note that if 
the graph is balanced, 1^ is a left eigenvector of L associated with Ai = 0. 

To fix terminology, some basic connectivity notions are now in order. A (directed) path in a 
digraph Q is an ordered sequence of vertices, such that any pair appearing consecutively is an 
edge of the digraph. A vertex of a digraph is globally reachable if, and only if, it can be reached 
form any other vertex by traversing a directed path. A digraph Q is strongly connected if, and 
only if, every vertex is globally reachable. Next, some relevant properties of the Laplacian are 
summarized in Proposition [H 

Proposition 1: Let Q := {V,£,A) be a digraph of order n, and L its associated Laplacian. 
Then, 
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(i) all the eigenvalues of L have nonnegative real parts; 

(ii) if Q is strongly connectecH then rank(L) = n — 1, i.e., is a simple eigenvalue of L; 

(iii) for any r G [0,t], e"^*^*""^) is a row-stochastic matrix. 

Statements (Q) and du]) are proved in |l39l Theorem 1.37], and statement dm]) is a direct conse- 
quence of the fact that the rows of the Laplacian L sum to zero. 

The following proposition characterizes the statistics of the process {x{t) : t > 0} produced 
by ([5]) given deterministic zero initial conditions, i.e., Cov(xo,Xo) = and IE[xo] = 0. 

Proposition 2: Let x(0) = with probability one. Then, the general solution of ^ is 

x{t) = [ e-^^'-^^bdr + f e^^^'-^^HdW, (7) 

in which the stochastic integral is interpreted in the Ito sense. In addition, 

(i) the mean and covariance of ([7]) are given by 

E[x(t)] = / e-^(*-")Mr (8) 
Jo 

and 

CoY{x{t),x{t)) =a^ [ e-^(*-")e-^^(*-")cir, (9) 
Jo 

respectively; 

(ii) the stochastic process {x{t) : t > 0} is Gaussian. 

The proof of Proposition |2] is a straightforward consequence of ll40l pp. 131-132]. The lemma 
below provides lower and upper bounds for the variance of the state of each unit. The lower 
bound will be important in defining an index that characterizes the certainty of each unit as will 
be discussed in Section Hill 

Lemma 1: Consider ([5]). For any interconnection digraph Q = (V, £, A) and any node Vk E V, 

E[xfc(t)] = (10) 

and 

2 

<yar{xk{t)) < aH. (11) 

'Note that this condition can be relaxed to graphs that contain a globally reachable node. However, in Section |lll| we focus 
on strongly connected digraphs with normal Laplacian matrices, which by (3) Lemma 4] are balanced. For balanced graphs the 
two conditions are equivalent; see 1381 . 



October 17, 2012 



DRAFT 



I. POULAKAKIS, L. SCARDOVI, N. E. LEONARD 10 

Proof: Equation (flOl ) is an immediate consequence of ([8]) for 6 = since, by Proposition 
[THiiil). e"^*^*""^) is a row-stochastic matrix. To show (fTTI) . let q^^ be the n x 1 vector with all 
elements equal to zero except element k, which is equal to one; note that Yllt=i ^fc = !«• Then, 

Var(xfc(t)) = qfcCov(x(t),x(t))qfc 

2 /■*|| -LT(t_,) 2, 







Jo ^ ^ 
where ^ has been used. The lower bound in (fTTI) is obtained through Jensen's inequalitjB 

Y: (qJe-^^(-^)q.)' > i $:qJe--^(-^)q, , (13) 



^=1 \e=i 

rTf 



by observing that ^*"^^qfc corresponds to the k-th column of e^^ that is, the fc-th row 
of e~^^^~'^\ and by noticing that e"^^*^'^^ is row-stochastic by Proposition [Tlliiil). Finally, the 
upper bound follows from 

2 



£=1 

in a similar fashion. 



(qJe-^(-^)q,) < J2 |qJe-^(-^)q, 




(14) 



Remark 1: Lemma \T\ shows that the expected value of the evidence accumulated by each 
unit increases linearly with time at a rate (3, which is the same for all units regardless of 
the interconnection topology. By way of contrast, the covariance matrix does depend on the 
interconnection. This implies that certain communication topologies — and certain nodes within 
them — may be better than others in terms of certainty in integrating information. In view of the 
fact that a'^t is the variance of the state of an isolated DDM, the upper bound in (fTTI) implies 
that the uncertainty associated with any of the interconnected units cannot exceed that of an 
isolated unit. 

Remark 2: When t is sufficiently small, by expanding the exponentials in ^ in Taylor series 
and neglecting higher order terms, Cov{x{t), x{t)) ~ {a^t)In. This fact implies that all units 
behave like isolated DDMs at the beginning of the process. It will become apparent in the 



Jensen's inequality: Let / be a convex function on an interval J' and Xj £ J for j G {1, n}. Then, / — s^j j ^ 
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following sections that, as time evolves and the units collect and communicate their accumulated 
evidence, their certainty improves with respect to that of an isolated DDM in a way that depends 
on the topology of the communication. We are interested to identify units with variance that 
evolves more closely to the lower bound in (fTTI) . 



This section introduces an index that characterizes the certainty of each unit as it accrues 
evidence. We will restrict our analysis to strongly connected digraphs Q = {V,E,A) with 
Laplacian matrices L that are normal; i.e., matrices that commute with their transpose, [[4T1 
Sec. 2.5]. 

For each G V we define the node certainty index yU : V — ?■ ]R>o U {00} as the inverse of the 
difference between the variance Var(xfe(t)) of the state Xk of node Vk and the minimum possible 
variance aH/n as t — +00; that is. 



A high value of fi{vk) corresponds to small uncertainty associated with the node Vk, since the 
variance of its state evolves closely to the minimum possible variance aH/n; see Lemma [H By 
convention, /i(ffc) = 00 corresponds to the highest possible certainty. 

Before we continue with interpreting the index (fT5l) based on properties of the interconnection 
graph, the following proposition shows that /i is well defined and provides a formula for the 
computation of fi in terms of the eigenstructure of the Laplacian. 

Proposition 3: Let Q := {V,E,A) be a digraph, and L its associated Laplacian. Assume that 
Q is strongly connected and that L is normal. Then, 

(i) the limit in (fTSi) is well defined; 

(ii) the index /i can be computed by 



where Re(Ap) denotes the real part of the nonzero eigenvalue \p, p G {2, ...,n} of L, and 

u^l^^ is the A;-th component of the p-th normalized eigenvector. 
To prove Proposition [3l we will use the following lemma that provides an analytical expression 
for the covariance matrix 



III. Node Certainty 




(15) 




(16) 
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Lemma 2: Consider ([5]). Under the conditions and notation of Proposition [3l the elements of 
the covariance matrix are 

[Cov(x(t), = + 2Re(A,) ^^^^ 

where denotes the complex conjugate of u]^ . 

Proof: By the normality of L there exists a unitary matrix U, such that U*LU = A, where 
f/* is the Hermitian transpose of U and A is a diagonal matrix containing the eigenvalues of L. 
Substitution in Q results in 

Cov(x(t),x(t)) = {U G{t) U*) , (18) 

where 

Git) := re-(^+^)(*"^)dr, (19) 



and A is the diagonal matrix containing the complex conjugates of the eigenvalues of L. Letting 
U = . . . \u^% ^ gives 

n 

[Cov{x{t),x{t))l^ = a'Y,g,,{t)u^^uf\ (20) 

p=i 

in which gpp{t) denotes the p-th element of the diagonal matrix G{t) and is computed by (fT9l ) 



as 



t, if Xp = 0, 



9ppit) = \ I- e-2Re(Ap)i (21) 



2Re(A 



V) 



Since the graph is assumed to be strongly connected, by Proposition [IHn]) 1„ spans the kernel 
of L, implying that u^^'^ = (l/y/n) 1„ is the normalized eigenvector corresponding to the zero 
eigenvalue Ai of L, thus resulting in (fTVl ). ■ 
With the aid of Lemma [2l we can now proceed with a proof of Proposition [3l 
Proof: From Lemma [2] 

f 1 - p-2Rc(Ap)t 

Var(..W)^.=i + .^|:^l^|4'f. (22, 

By Proposition [H strong connectivity of Q implies Re(Aj,) > for p = 2, ...,n, and (l22l) indicates 
that 

f " 1 

Var(x,(t))-a^i < -^E^^I^^T' (^3) 



p=2 
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uniformly in t. In (|23l) equality is asymptotically attained as t +00, proving both parts of 
Proposition |3l ■ 

The dependence of the node accuracy index f^i on the eigenstructure of the graph Laplacian L 
according to (fT6l) reflects the fact that the certainty of each node is contingent upon its location in 
the underlying interconnection graph. Classifying the nodes of a graph based on their certainty 
and interpreting this classification in terms of the structural properties of the interconnection 
graph will be discussed in Section |W] below. The following remark provides further intuition 
about the index yU. 

Remark 3: From (fT6l) it is easy to see that 

1 "1 
^ /IM " ^ 2Re(A J • ^^"^^ 

As was discussed in [[3l in the context of linear consensus protocols in the presence of additive 
white noise, the sum in the right hand side of (|24|) corresponds to the expected steady-state 
dispersion around the consensus subspace. Hence, the inverse of /i(t'fc) can be interpreted as the 
individual contribution of the node to the dispersion of the evidence; the higher iJ.{vk), the 
smaller the contribution of the node v^. In the case of undirected graphs, the sum (l24l) is related 
to the effective resistance K{, or Kirchhoff index, of the graph 

n 

^r-=ny2—; (25) 

see ll32l . Clearly, for undirected graphs 

^ M^^^'(i)- '''' 

IV. Node Certainty as a Centrality Measure 

In this section, the node certainty index fi is characterized in terms of the structural properties 
of the underlying interconnection graph. It is intuitively discussed in Section IIV-AI that node 
certainty depends on the totality of paths — and not just the geodesic paths — in the network. This 
observation is rigorously formalized in Section IIV-BI which reinterprets the node certainty index 
as a centrality measure by establishing its connection with the notion of information centrality. 
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A. Motivation 

To motivate the discussion, we provide an example of an undirected graph; see Fig. \T\ For 
each node Vk, we compute the certainty index /i(ffc) using (fT6l) . and provide its degree; that is, 
the number of edges attached to Vk. In addition, the corresponding closeness centrality, KcIosc, is 
provided as a representative geodesic-distance-based measure of centrality. Defining the geodesic 
distance d{vk,Vj) between Vk and vj as the length of the shortest path connecting them, the 
closeness centrality of a node Vk is computed as the inverse of the mean geodesic distance 
d{vk, Vj) averaged over all nodes Vj, i.e. 



see ll26l Section 7.6]. The example of the graph of Fig. [U demonstrates that, for general undirected 
graphs, node certainty cannot be captured by centrality measures based on degrees or geodesic 
paths. This is a consequence of the fact that the evidence accumulated by each unit is transmitted 
through the network and reaches the rest of the units via circuitous, non-geodesic pathways. 

In more detail, from Fig. [T]note that //(fs) = /i(t^4) > yu(f5). This distinction between and 
{^35^4} cannot be captured by their degrees, which are all equal to 2. Closeness centrality too 
cannot discriminate between and ^5. In fact, the different certainty levels of V4 and cannot 
be captured by any centrality measure that is defined based on geodesic paths. To see this, note 
that any of the vertices v^, and in the graph of Fig. [T]is connected to the rest through two 
geodesic paths of length 2 and two geodesic paths of length 1. Hence, excluding non-geodesic 
pathways, these nodes are equivalent, resulting in Kc1osc(^^'3) = '^ciose(^^4) = '^ciosc(^5)- 

To provide further intuition, consider the pairs {f 1, v^} and {vi, v^}, and enumerate all possible 
paths connecting them. For {vi, v^} we have the paths vi — V4, vi — V2 — vs — V4 and vi — — 
V2 — V3 — V4; for {vi, v^} we have the paths vi — v^, vi — V2 — and vi — — 1^3 — v-2 — v^. Thus, 
the evidence transmitted by vi reaches via three paths of length 1, 3 and 4, respectively. On 
the other hand, it reaches via three paths of lengths 1, 2 and 4, respectively. This difference is 
reflected in the node certainty index, revealing the non-geodesic nature underlying information 
transmission, which requires that all possible paths between any pair of nodes in the network 
must be taken into account. 




(27) 
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Vertex Degree ^ciose 




1.00 8.33 

1.00 8.33 

0.83 5.26 

0.83 5.26 

0.83 5.00 



Fig. 1. Left: The connected undirected graph used to illustrate that all paths — not just the geodesic ones — must be taken into 
account in interpreting /i. The nodes that maximize the certainty index are i^i and V2, and the node that minimizes certainty is 
Us. Right: The table summarizes properties of the nodes; namely, degree, KcIosc and /j.. 



B. Main Result: Node Certainty and Information Centrality 

This section clarifies the relation between node certainty, as characterized by the index /i, and 
the location of a node in the underlying interconnection graph through the notion of information 
centrality Il29l . 

To define information centrality, we begin with a weighted undirected graph Q = (y,S,A), 
which is assumed to be connected. Let w : £ ^ ]R>o be a function that assigns to each edge 
e e £ a. positive weight w{e) and consider a pair of vertices Vk,Vj G V. Suppose there are m^j 
paths Vkj{r), r = 1, nikj, connecting and Vj and define the weighted length of path Vkj{r) 
as 

UVi.,{r)):= Y: (28) 

The definition of the length £^ in (l28l) reflects the convention that the higher the weight of an 
edge the more important the communication between the incident nodes of that edge is; hence, 
these nodes appear to be "closer". 

To capture the effect of non-geodesic pathways, we define the distance between two nodes Vk 
and Vj based on a "combined" path Vkj that incorporates all the paths Vkj{r), r = 1, ...,mkj, 
connecting and Vj. To do so, define the mfcj x m^j matrix D^j as follows: its diagonal entries 
Dkj{r,r) correspond to the weighted lengths of the paths Vkj{r), 

^fci(r,r) = C(ni(r)), (29) 
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and its off-diagonal entries Di^j{r, s) correspond to the sum of the inverse weights of the edges 
that are common between paths Vkj{r) and Vkj{s) for r, s G {1, ...,mkj} with r ^ s, i.e. 

Dkj{r,s)= V (30) 

w(e) 

Then, the length i^iVkj) of the combined path is given by 

and the distance between Vk and vj is defined as 

d{vk,Vj) := inj{Vkj)- (32) 



Stephenson and Zelen in 11291 define the total "information" contained in the entirety of paths 
connecting Vk and Vj as the inverse of the length of the combined path 

hj ■■= ^ — , (33) 

{Vk,) 

with iwiVkj) computed by (|3T1) . and use hj to compute information centrality of a node Vk as 



the harmonic averageli 



-1 



The connection between information centrality and node certainty can now be established. 
Theorem [T] below relates the certainty index of a node in a strongly connected weighted 
digraph Q = (y,£,A) with normal Laplacian to the information centrality of Vk in the mirror 
graph C of Q. To define the mirror graph ^ of ^ suppose that £ is the set of reverse edges of Q, 
obtained by reversing the order of nodes of all pairs in £. The mirror ^ of ^ is an undirected 
graph Q = {V,£,A) with set of vertices V = V, set of edges £ := £ Li £, and with adjacency 
matrix A = [akj] with entries 

. _ . _ akj + ctjk _ 
o^kj — cijk — 2 ' 

see also BUI Def. 2]. 



3 , 



An alternative definition was provided in 1311 that uses the arithmetic instead of the harmonic average. Note that the two 
versions of information centrality do not always give the same ranking; for instance, in the example of Fig. [T] node ranks 
lower than 114 with the classical definition, but it ranks higher according to the definition with the arithmetic average. 
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With this notation, the following result can be stated. 

Theorem 1: Let Q = (V, £, A) be a strongly connected digraph on n vertices and assume that 
its Laplacian matrix L is normal. Then, the certainty index of the node Vk G V is 

1 1 (35) 

where Kinfo(^^'fc) is the information centrality of Vk in the mirror graph Q of Q and Kf is the 
Kirchhoff index of Q given by (|25l) . Hence, if /ci, /c2, are indices such that 

/i(wfci) > ^^{vk2) > ••• > f^{vkj, (36) 

then, 

kinio{Vki) > hnioiVk^) > ••• > hnioiVk^), (37) 

and vice versa. 

Before continuing with the proof of Theorem [H which is the subject of Section IIV-CI below, 
a remark is in order. 

Remark 4: In the case where the graph Q is an undirected tree, for every pair of nodes 
VkiVj E Q there exists a unique path Vkj connecting them. Then, (l33l) implies that the total 
information transmitted between Vk and Vj is equal to the inverse of the weighted length iwi'Pkj) 
of Vkj- Hence, (l34l) reduces to (ITTI) . which indicates that closeness centrality can be used to 
discriminate the nodes of undirected trees. 

C. Proof of Main Result 

In this section. Theorem [T] is proved through a sequence of lemmas. We start with a lemma 
due to Stephenson and Zelen ||29ll , which provides a way to compute Ikj defined by (l33l) without 
path enumeration. 

Lemma 3 (Stephenson and Zelen, l[29\]}: Let Q = (V, £, A) be an undirected connected graph 
of order n and let L be its Laplacian. Then, the total information Ikj transmitted via all paths 
connecting Vk,Vj G V is 

hj = {ckk + Cjj - 2ckj)~^ , (38) 
where Ckj, 1 < k,j < n, are the entries of the matrix 



-1 

'-n-^n 
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Next, we provide a lemma that relates the node certainty index fi to the group inverse of the 
Laplacian L of the mirror graph Q of the interconnection digraph Q with normal Laplacian L. 
Recall that the group inverse of an n x n matrix P, when it exists, is the unique matrix X that 
satisfies: 

(i) PXP = P, (ii) XPX = X, and (iii) PX = XP; (40) 

see [|42l Sec. 4.4] for details. In what follows, the group inverse of a matrix P is denoted by 
P#. 

Lemma 4: Let ^ be a strongly connected digraph with normal Laplacian matrix L. 

(i) The symmetric part of L, 

L := (41) 

is a well-defined Laplacian for the mirror graph ^ of ^. 

(ii) The group inverse of L exists and is unique. 

(iii) Let U = [u^^^ \ U^'\ be the unitary matrix that diagonalizes L, where u^^'^ = (1/a/?2)1„ is 
the normalized eigenvector of L corresponding to the zero eigenvalue Ai = and Ur is the 
n X (n — 1) matrix containing the rest of the normalized eigenvectors of L. Then, 

L* = U, (U*LU,) V;. (42) 



Moreover, 

^L^k- (43) 



— L* 



Proof: (i) By |l3l Lemma 4], strongly connected digraphs with normal Laplacians are 
balanced. The result follows from [21, Theorem 7], which states that if Q is balanced, the 
symmetric part L of its Laplacian L is a valid Laplacian matrix for the mirror graph Q of Q. 

(ii) By ll42l Theorem 1, p. 162], the group inverse of L exists and is unique if, and only if, 
rank!/ = rankL^; that is, if, and only if, the index of L is one. Since L is singular, this condition 
is equivalent to requiring that the Jordan blocks corresponding to the eigenvalue A = are all 
1x1; see [|42l Theorem 6, p. 170]. Hence, in view of Proposition [Tl|Iil), the group inverse of the 
Laplacian L of the mirror graph of a strongly connected digraph exists and is unique. 

(iii) Since L is normal and U the unitary matrix that diagonalizes L, we have LU = UA, 
where A is a diagonal matrix containing the eigenvalues of L. Using the property U^^ = U* 
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we obtain U*L = AU*, which, by the fact that L is real and A diagonal, results in L^U = UA, 
where A is the complex conjugate of A. Since U = [n*^^^ | U,.] , these observations imply 

[L + L^) U, = U, [A, + A,) , 

where A^ = U*LUr. Using this fact, and the properties 

= In --lull, (44) 

n 

U:U, = In-l, (45) 
it is straightforward to show that the matrix 

X = U, (ufLU.y^U* 

satisfies the requirements for the group inverse; hence, we deduce that L* = X. Further- 
more, 

from which we obtain that the (/c, j)-th entry of L* is 



p=2 



P 



The result (1431) follows for A; = j in view of (fT6l) . ■ 
The following lemma collects some useful properties of L*. 

Lemma 5: Let be the group inverse of the Laplacian L of a connected undirected graph 
Q. Then, 

LL* = L*L =4-il„lT (47) 

n 

iTl# = L#1„ = 0, (48) 

Tr(L#) = — , (49) 
n 

where Kf is the Kirchhoff index of Q. 

Proof: Equations (gV]) and (HE]) follow from dUl) in view of (l44l)-(l45]) and of the facts that 
l^Ur = U*ln = 0. For (l49l) we note that, by the proof of Lemma SI if Ap is an eigenvalue of 
L, then Ap = (Ap + Ap)/2 = Re(Ap) is an eigenvalue of L. Then, by (|46|) . 



n ^ ^ 



k=i k=i K ^ 
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by the definition of the Kirchhoff index (|25] ). ■ 
The following lemma establishes a correspondence between the group inverse L* of the 

Laplacian of Q and the inverse C of the matrix L + IrX^, whose entries are used to compute 

the information 7^ via (l38l) . 

Lemma 6: Let Q be an undirected connected graph of order n with Laplacian matrix L. Then, 

C = (L + lal)"' = L* + (50) 



where L* denotes the group inverse of L. 
Proof: The result follows from 



(L + l„lj) (^L# + ^Inll) = + (^In) In 

+ 1. [^IL*)+IU11 



where Lemma [5] and the fact = n have been used. 
Theorem [T] is now proved by combining the lemmas above. 

Proof: The definition of information centrality (l34l) combined with (l38l) gives 



1 1 



By (pOl) in view of (1431) we have 

1 f# 1 2 1 1 

In addition, by (|50l) and the definition of Kirchhoff index (|25|) . 

- c,, = lTr(L#) + 1 = li^f + 1 (53) 

and 

1 ^ 2 1 



n '■ — ' n \ — ' n I n 

i=i \i=i 



2 

~2' 



where (l48l) was used. The result follows. 



(54) 



V. Classes of Normal Graphs 

This section examines how the node classification based on the certainty index /i depends on 
certain graph parameters, e.g. the order of the graph, for some common families of graphs. 
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A. d^-Circulant Graphs 

In these graphs, each node is connected to c/q other nodes, where cLq is a fixed integer in the 
interval [2, — 1]. For example, the complete graph is (n — l)-circulant and the undirected ring 
is 2-circulant; see Fig. Uta). The corresponding Laplacian can be completely determined by its 
first row; In more detail, if {/q, /i, .../n_i} are the elements of the first row of L, then 

-^k,j ^{k—j) mod n- (55) 

Then, in view of results in [|43l . Lemma [2] gives the following expression for the node certainty 
index 



K^k) n 2Re(Aj 



where Xp denotes the p-th eigenvalue of L, 



n-l 

; 2Trq(n+l — p) 



/,e-^^"^. (57) 

q=0 

Clearly, (l56l) indicates that the value /i(ffe) does not depend on Vk, implying that 

/i(Wl) = fi{v2) = ... = p{Vn). (58) 

Hence, in such graphs, no distinction can be made among the nodes in terms of the variance of 
their state. 

In the particular case of a complete graph on n vertices, and assuming that a = 1 and that 
the weight of all the edges is equal to a, the corresponding Laplacian L is 

L = a {nin - Inll) , (59) 





(a) (b) 



(d) 



Fig. 2. Examples of normal graphs, (a) An undirected ring, (b) A directed ring, (c) An undirected star, (d) An undirected path. 
The undirected and the directed rings are examples of circulant graphs. 
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from which a computation detailed in Appendix \T\ results in 

fi{vk) = 2a -. (60) 

n — 1 

Thus, for a given coupling strength a, the index fi{vk) increases linearly with the order n for 
the complete graph. This implies that, after a transient, the variance of all nodes can be made 
arbitrarily close to the minimum achievable variance t/n hy increasing the order of the graphC- 

B. Undirected Star 

Assuming that vi is the center of the star (the highest degree node) as in Fig. [2lc), and that 
the weight of all edges is equal to a and a = 1, the corresponding Laplacian is 



{n — l)a —a 



(61) 



The structure of the Laplacian allows for an explicit computation of the covariance matrix; see 
Appendix [21 for details. 

By (fT5l) the resulting expressions for are 

^[vi)=a -, (62) 

n — 1 

, , 2(n-l)n2 
— In^ + 1 

for k = 2, ...,n. Clearly, since 

n — 1 
— n — 1 



for all k = 2, ...,n, we have /i(t'i) > yu(t'fc) for undirected stars of order n > 2. 

Due to the explicit form of /i, a number of interesting observations can be made. First, for 
a fixed a, by increasing the number of nodes n the index increases without bound. This 

reflects the fact that Var(xi) can be made arbitrarily close to the minimum possible variance t/n. 
On the other hand, increasing n also increases ij{vk), which though is upper bounded by 2a. 

'*This observation, however, does not extend to all graphs with circulant Laplacians. A counterexample is provided by the 
unweighted undirected rings, in which the variance is bounded away from zero as the order n increases. 
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Hence, contrary to the center vi, the variance Var(ffe) for /c = 2, n cannot be made arbitrarily 
close to t/n by increasing n. However, it is easy to see that 



1 



1 



1 - 



(65) 



which implies that as the coupling strength a increases the center essentially becomes equivalent 
to the rest of the nodes. In other words, a high value of a brings the nodes "closer". 



C. Undirected Path 

Consider an undirected path of order n > 2 as in Fig. |2l^d). We assume that a = I and that 
all edges carry the same weight a. The corresponding Laplacian is 



a 


-a 


■■ 


■ 








-a 


2a —a 


■• 


• 











—a 2a 


—a ■ ■ 


• 









(66) 



■■■ -a 2a -a 

••■ -a a 
which has the structure of a symmetric tridiagonal matrix. Closed-form expressions for the 
eigenstructure of such matrices can be found; see Lemma |7] in Appendix [3l As a result, using 
fT5l) we can find 

1 _ 1 ^cos^^ip-m-l)] (67) 



COS 



From (l67l) it can be seen that nodes symmetrically located with respect to the midpoint of 
the path, i.e., the pairs (k,n — k + 1) for k = 1,2, n, exhibit the same certainty in collecting 
evidence; see Appendix [3l Moreover, the closer a node is to the midpoint of the path, the higher 
is its certainty index; equivalently, the closer is its variance to t/n. 

Finally, it is evident from (|67|) that increasing the number of nodes n results in higher values 
of yU, so that the variance of each node can be made arbitrarily close to the minimum possible 
variance t/n. In addition, the limiting case of strong communication, i.e. a oo, has the same 
effect as that in the undirected star, i.e., it brings node certainties closer. 
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D. Comparison Across Classes of Normal Graphs 



Fig. |3(a)| presents the inverse of the certainty index 1/ p, for three examples of circulant 
graphs — namely, the complete graph and the undirected and directed rings — and the undirected 
star and path graphs, all of order n = 9; see also Fig. [2l It is evident that the nodes of graphs 
with circulant Laplacian matrices are all equivalent in terms of their certainty. Furthermore, the 
nodes of the complete graph have the least uncertainty, since the variances of their states are 
closer to the minimum possible variance. Notice also that the center of an undirected star exactly 
matches the performance of the nodes of a complete graph; this can be verified by inspecting 
(|60l) and (l62l) . Similarly, the center of the undirected path matches the performance of the nodes 
in an undirected ring. 

Fig. |3(b)| presents the evolution in time of the variance associated with the state of the node 
that maximizes p in each of the graphs discussed above. Consistent with the results of Fig. |3(a)[ 
the variance of the center of the undirected star coincides with that of the nodes in the complete 
graph, and they both evolve closely to the minimum achievable variance aH/n; see curve (iv) in 

3r 
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(a) 
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Fig. 3. (a) Inverse certainty index for each node in tlie directed ring (y, red), undirected ring (A, black), undirected star (□, 
blue), undirected path (o, green), and complete graph (o, magenta). The best performance corresponds to the complete graph, 
and it is matched by the center of the undirected star, (b) Minimum variance for the graphs of Fig. |3(a)[ The grey lines (i) 
and (v) correspond to the variance of an isolated DDM {cP't) and the minimum achievable variance (a^t/n), respectively; all 
graphs are between these lines. The variance of the nodes in the undirected ring coincide with the minimum variance node of 
the undirected path, both represented by curve (iii); see also Fig. |3(a)| Finally, the variance of the nodes in the complete graph 
coincides with the variance of the center of the undirected star, both corresponding to curve (iv); see also Fig. |3(a)| The nodes 



in the complete graph and the center of the undirected star are the closest to the minimum possible variance a^t/r. 
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Fig j3(b)[ The same holds for the center of the undirected path and the nodes of the undirected 
ring; see curve (iii) in Fig j3(b)[ Fig. |3(b)| illustrates that the index fi effectively "compresses" 
the evolution of the variance in time to a scalar that can be used to rank the nodes in terms of 
their certainty and compare the graphs accordingly. 

VI. Examples of Non-normal Graphs 

In this section, two examples are presented of digraphs with Laplacians that do not meet the 
normality condition of Theorem [H but for which we can still compute the variance, an thus the 
certainty, of each node. These are the exploding and imploding stars, which are graphs commonly 
used in decentralized decision making ll44l . and consensus protocols [|45l . respectively. 

Example 1 (exploding star): The exploding star of order n is considered; Fig.|4tleft) presents 
an exploding star for n = 9. Its Laplacian, assuming equal weight a assigned to all edges, is 



(n — l)a —a 



(68) 





A computation presented in Appendix |4] reveals that the variance of the center is 

[n — l)^a n — 1 [n — l)^a ^^^^ 

, ^ { 1 _ -2(n-l)a^^ 

while the variance of all the other nodes equals that of an isolated DDM, i.e., Var(xfc(t)) = 
aH, k = 2, n. 

As expected, Va,r{xk{t)) > Var(xi(t)) for all A; 7^ 1 and t > 0, since the center has access to 
the information collected by the rest of the nodes, which operate in isolation from each other 
and from the center. Note that this relative hierarchy of "informed/uninformed" nodes — with the 
informed node being the center — persistjfl as the coupling strength a increases, and in the limit 
as a tends to infinity, the state xi of the center converges with probability one to the average of 
the states of the rest of the nodes; see Appendix IH As a final remark note that, for finite t and a, 
the larger is the number n of nodes, the smaller is Var(xi(t)); this implies that the uncertainty 
associated with the state of the center can be made arbitrarily small by increasing n. 

^This should be contrasted with the behavior of the nodes of undirected stars, in which as a increases all nodes become 
equivalent; see Section fV-BI 
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Example 2 (imploding star): Consider an imploding star of order n\ see Fig. |4](left) for the 
imploding star of order n = 9. Its Laplacian, assuming equal weight a assigned to all edges, is 





.2. 



(70) 



The variance of the center is Var(a;i(t)) = a t, equal to that of an isolated drift-diffusion process, 
and 

Var(a;fc(t)) = t + , (71) 

for k = 2, ...,n; see Appendix [51 



a 



Thus, the variance associated with the state of the center is always larger than the variance 
associated with the state of each of the other nodes. The difference between Var(xi(t)) and 
Va,r{xk{t)) for k G {2, n} as t grows eventually approaches the constant 1/a, which decreases 
as the coupling strength a increases. Hence, for strong coupling, the variance associated with 
each node deteriorates, approaching a'^t. Most important — contrary to all the graphs studied so 
far — the variances of the nodes of an imploding star are all independent of its order n. This is 
because information flows to the nodes from the center but not in the other direction. Hence, 
the pairs formed by each node together with the center are decoupled. 

Example [H shows that the center of the exploding star nearly achieves the performance of the 
nodes of a complete graph in terms of certainty; see Fig. |3(b)| and Fig.lH It is known however that 

3r 




o 

exploding star 



Fig. 4. Left: Imploding and exploding stars for n = 9. Right: Time evolution of the variances of the nodes of the stars on 
the left compared with undirected stars of the same order. From top to bottom: (i) variance of an isolated DDM, a^t, which 
coincides with Var(a;fe(t)) for k = 2, ...,n for the exploding star and with Var(a;i(t)) for the imploding star; (ii) ya,T(xk{t)) 
for k — 2, n for the imploding star; (iii) Yai(xk{t)) for k — 2, n for the undirected star (plotted for comparison); (iv) the 
variances of the centers of the undirected and exploding stars almost coincide; and (v) minimum achievable variance a^t/n. 
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exploding stars cannot achieve consensus because they are not connected. In the reverse case, the 
imploding star provides fast rate of convergence to consensus [|45l Thm. 2.38] in a deterministic 
setting and strong robustness of consensus to additive (white) noise in a stochastic setting [3; Fig. 
1], approaching the behavior of a complete graph as its order increases. However, as Example [2l 
and Fig. |4] reveal, the imploding star exhibits the worst performance in terms of the certainty of 
its nodes and the variance associated with their states cannot be affected by increasing the order 
n of the graph. These examples reveal a fundamental difference in the mechanisms that underlie 
robustness of consensus to noise and individual unit certainty in evidence accumulation. 



This paper investigated the effect of the communication graph on the certainty across a network 
of stochastic evidence accumulators. Each unit in the network accumulates evidence according to 
a drift-diffusion process based on its own noisy measurements and on evidence exchanged with 
other units according to the communication graph. The use of a drift-diffusion model to represent 
evidence accumulation was motivated by a class of collective decision-making problems. It was 
observed that the uncertainty in the network depends on the Laplacian of the communication 
graph, implying that certain nodes within a given communication topology can be more certain 
than others. To classify the nodes according to their certainty in accumulating evidence, a node 
certainty index was defined based on the eigenstructure of the graph's Laplacian. It was proved 
that the certainty index can be interpreted as a graph centrality measure through the notion of 
information centrality, which incorporates all possible paths connecting each unit with the rest 
of the network. These results show that evidence accumulation is a total network process, and 
can be used to identify units that are more influential than others in tasks that involve translating 
the accumulated evidence to decisions. 



1 ) All-to-all Communication: The k-th power of the Laplacian defined in (l59l) is by induction 
to be 



VII. Conclusion 



Appendix 



a\t-T)'{n''I-n''-'ll^). 



(72) 



Substitution of (1721) to the matrix exponential series gives 




,na(t—T) 



(73) 



n 
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from which, through we obtain 



Cov{x{t),x{t)) = 



1 - e 



-2nat 



t 1 - e" 



-2nat 



11^ 



2na \n 2n'^a 

2) Undirected Star Topology: By induction, the k-th power of the Laplacian of an undirected 
star of order n is 

n^~^{n — 1) — n^"^l^_^ 



' k 

J = a 



(74) 



^1 /+(E-:o^^Jii 

where 1 corresponds to an -dimensional column vector of ones and / is the (n — 1) x (n— 1) 

identity matrix. Substitution of (l74l) in the matrix exponential series gives 

ei(t,n, a) e2{t,n,a)l^ 

e2(t, n, a)l„_i e2,{t, n, a)I + 64(^5 n, a)ll^ 



-L{t-T) 



(75) 



where 



ei(t,n,«) = i + ^^e-"(*--), 62 (t, 



n, a 



63(^,0) =e 64(^,77,, a) 

Substituting these expressions in ^ we obtain 



1 g-nQ(t-T) 



1 e""'*""^' I e~""('~^) 
71 n— 1 n(n.— 1) 



(76) 



Cov(x(t),x(t)) = (T^ 



Ci C2 1^ 

C2 1 C3 / + 04!!^ 



(77) 



in which 



ci(t, n, a) 
C3(t,a) = 



^ + ^ (1 - e-2"°*) 



t l-e" 



l-e" 



C2(t, n, a 



(I 2?i^a ' 



(78) 



2a ' ^ 2{n-l)o ' 2n2(n-l)a' 

Undirected Path Topology: The Laplacian (|66l ) is a symmetric tridiagonal matrix and the 
following lemma applies. 

Lemma 7 ( l\46\l): Let L be the Laplacian matrix (l66l) . Then, for p = 1, 2, n. 



Ap = 2a I 1 — cos 



-ip-l) 

n 



(79) 



is an eigenvalue of L, and 



u 



iv) 



n 



cos 



^(P-i)(*-i) 



P = 1 



p = 2, ..,n. 



(80) 
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is the k-th, k e {l,...,n} , component of the corresponding normalized p-th eigenvector. 
In view of Lemma U\ Lemma [2] gives 



t 2^1- e~^^^ 



[Cov(x(t),x(t))L^. = aM- + -5^ 



Ap) 



n 2A„ 

p=2 P 



where 



eg = cos 



cos 



TT , , , 1 , 



(81) 



(82) 



Then, the variance of each node is readily obtained for j = k, resulting in (1671) . Finally, to show 
that the variances of the nodes that are symmetrically located with respect to the midpoint of 
the path are equal, note that 

(83) 



Ap) _ Ap) 

Sfc,A: >'n-k+l,n-k+l 



due to the fact that 



cos 



cos' 



^(p-l)(n-A; + i) 



0. 



(84) 



4) Exploding Star Topology: The A;-th power of the Laplacian of the exploding star is found 
by induction to be 





Substitution of ([85]) in the matrix exponential series results in 

■ -(n-l)a(t-T) _J_ (l_ ^~in~l)a(t~T)\ ^ 
n—1 \ J 

/ 
Substitution of (l86l) in ^ resuks in. 



(85) 



-L{t-T) 



(86) 



Cov(x(t),x(t)) = a' 



C2 1 t I 



(87) 



where 



Ci(t, n, a) 



C2{t,n,a) 



+ 



t 



+ 



-(n-l)at 



{n — lYa n — 1 (n — l)'^a 
n 



2(n - 



(88) 



-(n-l)at 
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Note that for fixed t and n ([88] ) implies that, 

Urn Cov{x{t),x{t)) = (T^ 



t t 
n— 1 1 

1 t I 

.n—1 



(89) 



and the limiting covariance matrix is singular with dim[A/' (K(t))] = 1. To provide insight into 
the singular nature of the random vector x{t), consider the new variable 



y = xi 



n 



1 

i=2 



(90) 



where Xi is the state of the informed node. Then, lE[y(t)] = and Var(y(t)) = meaning that 
y is deterministic. 

5) Imploding Star Topology: Observe that = a^L, i.e., the Laplacian of the imploding 
star is an indempotent matrix. Hence, the /c-th power of L is 

o" 



-1 / 



(91) 



from which 



-L{t-r) 



(1 - e^"(*~^)) 1 e""(*~^)/ 



(92) 



Substitution in ^ leads to 



Cov(x(t),a;(t)) = 



t CilT 
Cil Call^ + Cg/ 



(93) 



where 



1 — e~"* 3 

ci(t, a) = t , C2(t, a) = -- — h t + 

a 2a a 
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